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SECTION ONE i INTRODUCTION 

Tilts s*enioran4t» describes a program which finds bodi es in ft scene* 
presmnftbly formed by 3-dimensional objects H with some of them perhaps 
not carnpieteLy visible, 

When SEE —the pretentious name of the program--4ft a lyxC8 the acene 
TRIAL (see figure ^TRIAL 1 }: the results 3 to 
(BODE 1. IS :6 :2 :1) 

(BODV 2. IE ill :12 :1&) 

{BODtf 3- IS ;4 ]3 :7 ;S :S :I3) 

NIL 

SEE looks for 3*d 1 mens 1 onaI objects In a S’diffieneioriftl scene; the 
acene Itself is not obtained from a visual Input device* or from sn array 
of intensities or brightness; rather, supposition [r, e de that a pre-pro¬ 
cessing of scDe sort ha* taken place, and the scene to be analysed is 
available In a symbolic format (to he desttlbed ooon)* in terms of points 
{vertices) lines (edges),, and surface^ (regies)* 

SEE does not have a pre-conceived idea of the £om or model of the 
objects which could appear in a given scene? the only supposition baing 
that they aTe solid objects fomed by plane surfaces, in this way F it cnti 
not find ’'cubes 11 -or "houses 11 in a scene, since it do^s not know what a 
“"house 11 is. Once SEE has partitioned a scene into bodies h som£ other pro¬ 
gram, prehabIy b matcher* will work On them and decide which of those 
budies are "houses- 11 

Therefore p SEE forms a welcomed link between a pro-pirot&ssor [1 3 2j 
which transferals intensity pictures into point or line pictures (*), and 
a recognizer (aueh as TD [3] or DT [d])j which handles this line picture 
and finds bodies * objects Or zon^S Batching with certain patterns or 
cmdels- Instead &F Storthing through the whol^ scene locking for parts 
to match its models * the work of the recognizer (**) becomes simpler after 
SEE has partitioned the sccn^ into bodies* because tbt data to be searched 
{matched) is said 1 lor and better organized- 

■ ■ ■ ■ ■ 

(*) A description of these processes in analysis of scenes 1$ given in [5]* 

(**) Assuming the recognizer is interested in bodies whieh SEE can see (see l5J) a 


The analysis which SEE makes of the- different ee^ncs is generally 
&Ccepta"bl-5 * although in some ambiguous eases it he have s rather conservatively- 
Diatrifaytei over these pages * the reader will find examples of scenes 
analyzed "by SEE * and the peculiarities and behavior of the program will 
becotae clear - 

The program SEE is written in LISP* ar.d hajs been tested in the 
machine of the Artificial Intelligence Group, Project 14A0 , A preliminary 
version was written in CC'tP/EKP h and tf&s sxteneively used for ^utek test of 
ideas which shaped the program to its actual form- 



6 . 


SECTION TWO; INPUT FGKXA.T 

Tfie next section ^orm&t of a Scene 1 , describes the form in which SEE 
expects the scene to be; eventually, this data will COm« from e. visual 
input device (vidissector], through a pre-processor; nevertheless t fear 
testing purpo&ea , the scenes are entered by hand In a simplified I'cnnat 
(culled Input format}, and then some routines produce frm it the necessary 
data for utiliB&ticn by SEE. We will describe both in this section, which 
may he — together with the next one — skipped by the reader without much 
loss of continuity, 


Exacpla of a Scene: Suppose we want to describe the scene 


by giving (in LISP) a value to 'CUBE 1 
(SETQ CUBE {'SUCCZ (A 1.0 1.0 (:1 B f4 


B 1.0 5.0 (:1 fi -.2 

C 3.0 7‘0 (;3 E ;Jt 

D a.Q 7.0 (:S £ ;3 

E 6.0 5-0 (;3B si 

F fl.O 3.0 (;3 G 

G 6.0 1.0 {si A sit 


G] 

C :k A) 
E) 

F z'H C) 
G J3 D) 
D) 

F 1 3-’ E 3 



1 CUBS'. 


Ve begin 


Following each "vertex, we give its coordinates and a Iist>, counterclockwise 
ordered t of regions to which that vertex belongs and vertices to which that 
vertex is connected.;, in the next section this list receives ^he naroe "KJNDV, 
and is gkxtb f'-J-ly descrited. 

'The conversion of the scene, as Just given, into the form which S3E 
expects^ is ir.ade by the fufiction LLEM; thus., (IiLEiUL CUEEj will put in thft 
property liat of CUBE the properties BEj&IGJTS. and VEET'ICEEj in the property 
list Of each vertex* the properties XC0R* YCDR-, KEEGIOKS^ HVEHFXCES an4 KIHD; 
in the property liet of each region* the properties TCEIPEBQKS and KYERTICES. 




Then, ve evaluate (POOP (GET (QUOTE CUBS) (QUOTE REGIONS) }} * Khich puts 
the property FOOT to each rsgion+ All these properties are described In detail 
in the next section. 



Figure ’CUBE',i scene. 


Finally, we perform 
(MAPC (FtmCTIOK [LAMHEA (x) 

( FLPEPROP X f QUOTE 3ACKEFI0UHD) {QUOTE 3ACEGS0UBE}})) 
{ FUT?R0P (QUOTE CUBE) (QUOTE (;il)} {QUOTE RACKGROUND)}} 

H, ■ ‘ ■ ■*■ T 

Ve now Rive a mere complete example* The following is the file' TRIAL LlSPi 
when loaded, it puts the scene TRIAL (see fig, 'TRIAL') in the fona which 
SEE ■?x p-*®-c t e „ 



0. 


/ 

-—_ (NQTlSEro T*UL (QUOTE 

(A 2 . D t*0 [tj 4 *14 3 ) 9 2,3 l . U [I? J II 4 *14 Cl 
; 3,5 1.0 ( ia 3 -14 fl] c 5*0 4+0 ( 1 2 L 114 cc *5 :t 
.* 5.5666665 S..1333J33 (16 i; 17 F *3 111 
1 6.0 6*0 (5? -» *5 £ =3 E) S 6.5 7.3 M2 F *5 H IS J» 

-I 6.0 5*0 MS t » 6 S ) [ 5*0 9*0 rtl J IS ■* I 5 < j 

J 5*5 7.0 <IS I II 0 II? 5) * 4*G&&6S66 7*3333333 Ml 1 15 5 U v > 

* 1.1333313 6.5656666 [ *4 0 *3 "i t\ * > 

H 3* 56 5 56566 5*3333333 3 M3 * 114 A j | ^] 
y 2.0 7,0 M3 3 114 H) 0 2.0 9,0 M3 i. 14 P tU m ) 
p 1,0 10*0 Md 3 : 14 0> 0 J *0 11,0 M14 P la 4 i 5 9) 

9 4*0 11.0 MS 3 S1J 3} $ 0,[J |£J*0 [15 f 114 

T 6*0 10*0 r 4 5 J IJ 4 15 !J 9,0 7.0 MID _L 1 i A T 15 y> 

V ll.o 5. D M J 0 J 15 :f 19 4 1 w 11*0 4,0 (110 V *9 71 

* 10*5 4*0 m lo 4 18 r 114 y io,a 4.0 ng ? m u 

? 10,D 3*0 [19 <4 113 4* =14 V) A A 11*3 2,0 MU 4 4 19 99 1 14 1 j 
33 11*0 1*0 (19 CC *14 * A I CC 6.0 1.0 MB 0 I ] A 93 1 9 0D> 

Oil 9 ■ 0 4,0 M? is, 16 CC J it 7.0 4,0 it? E *3 DC IV r ~} 

7 '0 5,0 (17 49 y 15 F 1 EE 12*0 3.3 Ml 2 JJ >13 4 Ht HH) 

13.0 7.0 Ml 2 EG 114 (1J 

El 13,0 16,(1 (Ill jj tlJ HH 114 tl_ ) 

JJ 12*Q t?,0 (ill UL *10 S3 ±12 I|) 

10,0 2.0 Mil l *9 AJU LL **G 1*,0 If 10 JJ 111 11 U4 J 1 ) 

m . 


COE rs, 1DP IVfE* (L*»BS* TAX *¥ tV IT QX 2Y Dx Dfl 
i a 933- £ P 3 X 7 ] 

LSETQ * £iUQtI£VT (D [*F = REMQE DT CY) (DIFFEREHCE OX SX])J 
rsETQ 1 (QUOTIENT (DIFFERENCE 9* Af} i 0 [PRESENCE b* 4X1)1 
(SETQ M dlJS (Td£S >» C V h (*|ruJ5 Cy) (h[nUS (TI*ES 3 A XI 1 AYd 
(SETS X OUOTJENT X 1 0IFF ER tNCE P 3ll) 

(SETQ i df_US C Y ( T I H E 5 P (DIFFERENCE X CXt)l> 

(PElUR 1 * (tlST X Y ) 1 ) > 

i lL£n* ( L- a h 9 D a (a! 

£ In * V1 H 

(33Nn ( (H JLk *1 dJTP*0F SCtNt H [JUDfE RES|9NS)i 

f a JT p: ?OF SCENE y (QUOTE VEST | 3E5 H {^ElJ^N till 
£*jrP43= (CAP A) [0AD9 A)(3JDTE XCOff)) 
dJt?9D a (CAR AMSAflfl* A>£3JCTE YCD91) 
i^UtPRS^ ( CA=? AMCAnODR A ) i JO0T£ < ] YC M 
(SET0 1 

tCONS UlST tCAR Al 

i* fqg2 (Putprdp (Car a) (Cull (Caoou* All 

( QUOTE vrESI dais ] ) 

(PJt^RDP (CAP *1 

C CULL (CO* fCADES* Ml) 

(QUOTE YY-AflCEsm) 



9 . 


*) 5 

Ci-MA C*3fiDR A>) (S-tTU 0 rCD*#S [CAR AJ <i 1 } 

£"**0 ('JNCTI3N 

OAHRDA (*} (DR IHEM 3 ER A R> ( SETQ P £ ^ 0-^5 A ?n ) H 
t 2 JlL ( 0A Qn C R Ml) 

(sets a oeuioij* ah iqo 

exo* T 

■"ti 

=-■1 

(D£*-?RDP C0uL (UtHEtfA (AJ 

< EDO !MJl. A | A) ( (NJLU CDS A)| A 1 

(T lC3^i ICAR A ] £ SUlL ICDPS A f } j H ? - .—>■■—.. , 1:. 

' £ X * ^ J . P . •;. 

« ■ 

a 

■ il f 

ICE “OS? I LAMBDA (i 9 t] 

fANO O p, RDP 3 A Wj ICpRje A 6 \)J S 
f X a R t ’ 

f 0-‘ODP CLN*. <(.Ai30A O 

O3N0 (ON [MJlL iSMNJLL (CD* 3 i Jl it ' ' ; 

U>VJS.L CODR 3|) C 3 ROP (CAR 3> OaDR 3) IGUOTE K^NTl^Sl) 

■ C s R0P ICAR iCAQgoj? Atp CADR 3t '1 

CUOTE ^VERTICES)) : 

f U'JK CAR IC A aODR *)) CAR 3) 

(QUOTE NEUH0OPSI ) ] 

lli^K cap Bi CABDP 3t CUOTc ME f GwSQR % ] ) 

< C 3 RQA CAR 3) C A DR 9 > (QUOTE. < VERT 3 CES 1 t 

C a R3» (CACDR 3) COS 31 tgjore KVEATCHSM ICL^ OD&* 31)11 

"I 

a? ) 

(0£*s^ap \c 4^ai 9DA iy.) 

CIST (iJjfE CDHD) Mil CADR LI CAPO* UM 
C3NS IJ JUTE O ODOUR utJt) 

1*00 

(G£ SS R3R 0°RD p <_*i£»54 I A 5 C> 

CP 3 ISEIU IT CET A 0)1 lRJT a RQP * (CONS B tstCJIS 

EX’? ) 

tstfo scene cjjte triaum 

ISlO TP I CL£NA TRIA^U 
OE* 3 Pd s *&A3A£* RO^Sa POn j a t 
MAO frUNCHON CA^SOA 

(X) I P(jT 6 Rg 3 H 1UUDTE SACt^ROUhfl 3 I QUOTE 3 A CA G P Q JN C ) ) > ) 

( =Ul ’’3^ CJOTE TPJA..J f 9 J£J Tt (11*3 t IOJ0TE i A C A (i P P JNfl} ) J 
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POOP U4HI3D* [ E * > 

t s *032 [^u :0 (LAS T ( 3 ETQ It ( REVERSE 1 [JIM [.IM CA* M ) }) 

"HI 

P ° ^ 

I " . 

(0 E^ROP POOP* ILAHrJIrA (VI 
t £3*0 ( [ E3 1 

tsETQ u \. t \ 

(CAD* (SETS 11 - Z '>■' 

(N£KT,?Qf fScTO U CStl * (QUOTE 

S i V> - , .' 

Ml ' ■ 

( T tMEU^O I i ( FQO p* J] n I 1 

:XH ) 


[ DE r 3 S3* N E K T3 3 r (LAM3DA ( "> 


CjMO (io* MJi-L if (*ju_l tea* ?im (as ^ax i vEATio ? m 

(INJLw tCCZIS 1)] (CTiNQ tt£(J (CA* i) SI (LIST (CA* J) 

IT (3REA* 3 HtxrJOFl })} 
t (E 2 tCA* rtf *> („I$T ICADO* H) (CAOfl.mn 

tr c ne xi sop t cods 'mm 

EX 5 M 


tOAOS Mm* 


"T 

1 _ IR 


BK1 


. •• 

4 ^i 1 -- • 


( ** a c IFU^CTIO-M ( LA^SDA 
( M (*«0Q£ (?JfPWOP 1 

£CU_L tPUTPHOP * 

(FOD s 



(C**? tsEf < J: ■ 

t QUOTE <vE*TICES 1H 


OU0TE FOOPfM 
{QUOTE ME E QHa0*S i ) 

( J J tDP < ( C JL L (CD* (StF < (QUOTE FOOMIM 

(QUOTE fVE*1I0E») MM 
(*£r (QUOTE *E * i OaS > ] I 
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SECTION TKREEj FORMAT OP A SCENE- 

As said before* the input to OUT program is a scene in a special symbolic 
format, which ve proceed now to describe, 

I 

The Beene end its Componibts.- A scene Is fundamentally a collection of 
vertices and regions. 

A scene has a name which identifies it;. this is an atom, with its property 
11 st COMt billing the propert ie e ' REGIONS * t 1 ’VERTICES r , and 1 BAClffjEOVND 1 „ ?or 
example, the scene ONE (gee rigUcre 4 CNE H } has the name ’ONE 1 - In the 
property list of ’OWE 1 we find 

REGIONS — f:l ;£ :3 A l 5 :6) Unordered list of regions 

composing the scene OWE, 

VERTICES -- lAECSEFGHlJE) Unordcred list of vertices 

composing the scent: OHE- 

EACKC-30U1D — {"6) Udordered list pt regions 

composing the background 
Of the scene 0--E P 


C 



Fignre 'ONE 1 . A sce^e. 

Vertices and surfeces (regions) 
are the main components OT a scene, 
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Ecglotl*- A region corresponds to a surface limited by a simply connected 
curve, for instance, in OWE, A H C Is & region* Called :1, tut 5IJSDH 


is not. 


Each region has as name an atom which possess additional properties 
describing differar.t attributes of the region in question* These axe 
'EEICHBOES', 1 KVEKTICES 1 , and 1 FOGP f , For example, the region in Scene 05E 


formed ty the lines AE* 3D } EK, EC* d. , 

I 

property list of ;2 ^ fin-5 1 


has r ::2 p as ncme, In the 


lEIGtfSORS 


( -S r-4 e 6 rl : 6 ) 


^VERTICES 


[D E A C EO 


CouirtarclMfcwiEB ordered 

list Of all region? neighbors 
t-0 ,^ r Fox each r egi-on ? 
thife list is unique up to 
eye li cl permutation, 

Couftfe^rclockwise ordered 
Hs-t of all ^erticas which 
bfelOhg to the region -2, 

This list 1 e unique up to 
cyclic F Erniu t-&tlQnH 


FOOF 


h3 D :k E - t 6 A si C :6 K) 


Count erelockvisc ordered 
li fit of alternating neighbors 
and kverticea of z2* 

This list 1 e unique up to 
Oyclic permutation. 

Fox a region (say :E), FOCF starts with ar,y neighbor region {say l 3) * 
continues countexclockvise with the vertex belonging both to that region and 
that neighbor (tn our example, D; it belongs to :2 and 3 31, continues 
— counterclockwise siIveys -- with the next region fife), the next vertex 

(El, the next region {:6)* etc* 


NEIGHBORS and EVJUiTiCEE are then easily derived from FOOF[ take the odd- 
posit ioned elements of FOCF, and Its even-positioned elements, respectively* 



The FCOP property of & region is forced hy a :^an who ualks on its 

boundary having allweys this region to his left, and takes note of ths regions 

(*) 

to his right flJld of the vertices which finds in his way. 



Figure 'OME', 

Repeated here for convenience. 


As another example, the property list of the region ;h (see fig.. 0K3) contains: 
NEIGHBORS — (:5 t6 .6 :2 :l) 

KVEfrTICES ~ (G f ff & M} 

FGOF — (:5 0 :6 F :6 E :2 D :3 B) 

Vertex,— A Vertex is the point where two or mere lines of the scene meet;j 
for lutauct t A f G &tid K ure vortices of the scene ONE. 

Each Vertex has as name an -atom which possess additional properties 
describing different attributes of the vertex in question. These are 4 HCOR r t 
F Y’COfR r h ■ NVEfln ces F s ^HREGiowa 1 * end ’KJHD 1 , For oupthe vertex H 
(see scene ONE} has in its property list; 


XCOR 

3hD 

x—coordinate 


YCOR 

15*0 

y-c Oordinate. 2-d mens i onsj- 

flTORTXCES ~ 

(1 G D) 

Count er clockwi se 
list of vertices 
is connected. 

ordered 
to which H 
(**) 

RREGiona 

(:3 :5 

Count ereloc fcvise 
list of regions 
belongs [ ## ) - 

order ed 
to whieh H 


y PlfrCft£ vhere his path Chaoses direction or/and the region to his right 
changes Dtu, 

(■ ■) 

Thie list is unique up to cyclic permutation. 



{;% I ;5 G ih D) 


Kiri? 


Counterclockwise ordered 
list of alternating nregions 
ar.d nvertices of H (**). 


For & VcfttX (say H.), Kiln? starts With aqy neighbor region (say ;3), continues 
counterclockwise (around H) with the next vertex (l In our example], then the 
next region (:5)> etc. 

The KIHE property of a vertex is formed hy a man who Stands at the vertex 
and, while rotating counterclockwise* takes note or the regions and vertices 
which he sees, 

3EEEI0HS and NVERTICEE are then easily derived rrom (CUffis take the odd- 
positioned elements of KUTO, and its even-positioned elements, respectively. 


As another example, the property list Of the vertex E contains: 


EGOR 

YCOS 

VERTICES 

NRBOIONS 

KIKD 


1.5 

3.0 

(F A I>) 

(A l6 fS) 

( :1* F t6 A ;2 D) 



(**) 


this list is unique up to cyclic permutation. 
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SECTION FOCJS; TYPE OF VERTICES 

Vertices are classified according "to the slope, disposition and number or 
lines which fOTffl it. The function (TYFE&FtffFB ATOR L j, whore L is a list of 
vertices , performs this olaEsifiication., putting in the property list of each 
one of the elements of L, the type ~o which it belongs. 

The TYPE Of a vertex is always a list of two elements i the first is the 
ftUrpe-nojiis ; one of 'L' , 'FORK' , ’ARROW , 'T' , 'K*, "X* * 'PEAK 1 , ’MUMI'; the 
second eleoeht is tbe datumi generally is a list, whose form varies with the 
type-name , and Contains information In a determined order atout the vertex in 
question, 

tfe now proceed to describe the different types, their type-names and datum. 

Vortices where two lines meet. 


L-.- A vertex formed by only two lines is always classified as of type ’L 1 , 
Two angles exist at it, one bigger and other smaller than 1B0* The datum is 


a list of the form 

(E E ), where El is tbe region which contains 

the angle smaller than lfiCP. 

E_ is the region which contains 
the angle greater than ifeO 0 . 

For instance, in scene CR0B5 (ate fig. "CROSS 1 ), 
3 has in Its property lists 

TYPE — (L (;£ -. 9 )) 



The vertices of type L present in cross 
arc A, F» H, 1, JT „ Q, 
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<5 

Figure ’C HO S 5 f . 
used as an example 

Vertices where three lities nrct. 

FDRK,^ Hires lines: nesting at a point and forming angles smaller than iSo'"' 
fora a FORK* 

Jt& datum is the vertex itself 
at which the fork occur?- For instances 
vertex B has in its property list 
TYPE — fFOpK N) 

The vertices of type FORK present 
in CROSS are S h 

ARROW.- Three lines meeting at a point ^ with one of the angles "bigger than 1 & 0 °. 

The datum of an ARROW is a list like 
fE^ £ £ E^ E^ R^) where 

is the vertex at the |, tftil 1 , 

Eg lb the vertex at the center, 

E 3 is the vertex at the left-- ^ 

E^ is the vertex at the right< 

E c is the region at the left. 





* With. rfcspe.c.L Lo segment 3£ 
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Is the region at the right 

]L is the region which contains the angle "bigger than 
For instance t Tbertoc E has in its property list 

TYPE — {AEEO'rf (D E E 0 :1 i2 39)) 

The vertices or type AEROW present In CROSS are D, E, 


lSC C . 

— fig. CROSS.— 
K M. 


3 E k E *> V 


T,~ Three ooncurrent lines T of which two are colinear. 

The datum tor a T is a list of the Term (E^ E 
F^ is the vertex at the 'tail 1 of the T. 

is the central vertex + 

E^ is ■ a - Vftrtfflf mueh that 3. 3^ E^ is 
an a^glc "between 90 and 1&0 degree e. 

E^ is a vertex such that EL E^ is 
an angle smaller than 90 degrees. 

(That is ± E-^ E 0 are colinesr. 

E^. is the region which contains the 
angle between 90 and lflO degrees. 

Is the region which contains the angle aSL&llor th&P ?0 degrees 
3^ is ~he ’'central 1 " region -(where the 180° angle Is), 

For Instance, vertex R (fig, CROSS) h&3 in its property liet 
TYRE -- (T (C R Qfl ;S ;T :?)) 

The vertices of type T present In CROSS are B, L f ft. 


uhere 
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Vertices where f^ur lines meet. 


K.- When two of the vertices ei*e eoline&r with the center^ and the other two 
fall the same side Of Slfceh a lint. The datjm. is a list of the form 


1 *2 ], 3 ]! 5 E 6 ^ Ep} where 

E^ is the central region. 

is the region having the lSo D angle. 

EL^ is the colinear vertex which fells 


to the left of E ? . 

E l+ the region to the left fef £, -* 





E,; is- the cOliHear vertex which falls to the right of EI^ E n 
is the region tc the right of 


E 


a 


is the other’ vertex to the right [of E^) 


Tor example * we find in the property lifft of G the follosing (see fig. CROSS) 
TYPE ^ C'K ( s 3 :S C W H :9 It)) 


ft is the only vertex Of type K present in scene CEOSS. 


Jfr- When two of the vert ie as are colinear with the center * and the other tw* 
fall in opposite sides of such a linep The datjnn is a list of the form 


Eg E 3 E t S 5 wliore 

is one of the eol in-ear vertices . 

Eg is the region to the left of E^ C> 

where C is the vertex at the Cenrter. 
is the region lo the right of 
E^ i£ the other col inear vertex. 

]i._ t i.S the region to the left of E-. C, 

Eg is the region to the right of E* C. 

Fur instance p we find in the property list of Ps 




TYPE “ {X {N :6 s k Q. e6 t9)) 

The vertices of type X present in CROSS are C a P, 

The datnni for an X may also "be in the form {Ej_ E L _ Eg E^ E^ E_j . 
Yertices of four lines which are not pf type K or I are either of 
type FEAK or MULTI. 


Other types of vertices. 


PEAK. - Fenced hy fni_ir or more lines j, when the 
bigger than the YCORs &F the other vertices. 



TICE of the central vertex is 



MULTI 


MULTI,- Vertices foraed by four or more lines^ 


and not falling in any of the 
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The datum for vertices of type is of tne form E^, where 

?!. is the region which contains "the angle bigger thar. lSO degrees. 


The dat^rfl for vertices of "type MULTI is of the form , where E is 

the vertex itself. 


Here i.s now the frectiontTYPEGETTEHATOE L) ± where L is a list Of vertices 


i 0e-*^3* 
1 


> ] J 


T * a E 35 itER 4 TLH (L a "l3[)A EA> 

e fjwc (I jy 
< hmsoa im 
( e la^se* e _ so* ri. ? njj i 

t A Si 

e*utp»o s h 

l E LA MbPA E if l <2 K3 *4 ) 

t U.A'lSOA IK-j Kt> K 7 Afl ) 

(CJ'Mfl C 4 EG f 5£TG L 1 i .t 1 JGTH ZINC'S ) 4,1 

< CQ^U i 1 C^DSS- 1 X K2 N K4} 

ILiSf CGJDTE LI t LIs T <i 
il iLISf (SUOTl L> 

(LIST [£A^ < I SlO > 


K 3 > J i 




L ( - U L 

e comp 


h* J 


( l E ii U At i ICAQR St;-*) l C * Q J D R 5»J a M 
(LIST tflJOTE TJ 

elist K* n k 4 ta Ka m a j i h 

( (£ 3 J*L 1 CAIJR SlQRI iCaPT 5 ] ! 

(LIST (QJOTc T) r 

(LIST <4 N 12 A6 K3 <5 <1|}| 
{(CULML1 (GAilGD-i aL3“ > tCAOr? all 
(LIST OJUTE T t 

(LIST <2 M Ab (a Kl A3 <51Jj 

(IE>ual 

(SETa L 

J.L J3T (CRJS5* *2 N (4 41 
iCR3SS & Aa * A6 V I 
(CfO = S s K6 N i2 vlll 
{JUUTE (T T TIM 


4 “ jl 


~u> . JJ 




(LIST rQRAl S?M 

EiEwUAL L E^uJTE it T MlH ' 

iLiar [*JQTE arks* 1 ; : 

CL i ST <4 -V A 2 <6 <3 <5 All'll v. v ' ' ■ 
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The function SLOFGEffEMKJE generates 
■She indicator SLOP, for each vertex. 
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SEGHOU FIVE: IKE FRQGRAM 

As already mentioned, the recognition program called SE3 accepts a des¬ 
cription of a scene expressed in the aotflticrt Just described* and produces 

■ I 

as output lists containing the identification of the bodies present in 
the e c cne ■* 

In this section ve describe the program, and how it achieves 
its goals. We begin with a couple of examples 

Example 1. Scene T II f rThia scene (see figure 'II') is analyzed by SEE, with 
the following result®; 


(LOCAL ASSUMES (jf) (:13 :14) SAMS BODY) 

(BODY 1. IS :1 :2 :16 :1T) 

(BODY £. IS til ;l6 ;15) 

(BODY 3- IS :T :6 ;11 :12> 

(BODY h, IS :9 t8 :10) 

(BODY ?. IS :13 '.lk :5) 

(BODY 6, IS :20 :19) 


Results for scene 'II' 
(see next page) 


Example 2. Scene r BRIDGE 1 .- With this example* we give the details of the 
operation, We start by loading ir.to LIEF the following files (currently* from 


^lcrotape GUZMAN *) r 

(DREAD Sl^RT 1AF2) fQ 
(REMLAP T) 

(BREAD SEE 25) fQ 
(BREAD GHIERA 10) |C, 

(BREAD BRIDGE 5CE13 ) n 


SqnarE root, defined ill LAP 
Kill LAP' 

Scad SEE 

Scad ntixlliary functions 
Loading Of "this fil^ 

scene 5FHX3-E tc be reftd4 n t ci ® form&t 
described in Section transformed 

to ths proper :orz which SEE expects 
{tiE doscrihed in Section Three- 
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Figure, 'I I 1 . 

Tills scene is analyzed by SEE j vith 
results detailed in Example 1 , 

AIL bedims a.re- correctly found. 

Soiiie of the vertices Appear in fine 

drawi^ with, their names 5 Qther”"J.- 

■:' drawings we will generally omit thein^ 
we are also ow^ititig the coord, ins is 

^XPS ■ ^ r 
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(SEE (t&OTE BRIDGE}) 

SEE 25 AEALTEES BRIDGE 

FILLS 0EJ3E 

CLEAN 

evidence 

localevidence 


¥e call to 5EE> vitta the x 3 .ejt.c- 
cf the scene. 

DiffErenrt parts of the pxc^raEj 
print their name s.s they are 
ent exed, 


GLOBAL 

( (NIL} (( =B> C0017 G0015 G0Q14 00013 00012 00011 ) {{:T) G 0022 ) U:i 0 ) 00023 etc. 
LOCAL 

(LOCAL ASSUMES (ilfl) { :!?} SAME BODY) 

(LOCAL ASSUMES £l20) (:29) SAME BODY) 

(LOCAL ASSUMES (:10) (:£j ill r5 r6 :4) SAME BODY) 

(LOCAL ASSUMES £i7) {:& 1 11 t5 :6 :4 ;10) SAME BODY) 

{(NIL) ((sB ill :5 :6 3 4 ilO r r f) 00013 OOOlL 00011 G0017 00012 C0013 C0C20 etc. 
LOCAL 

(S3S0LE3QDY ASSUMES (;ly :18) (:16) SAME BODY) 

(t(: 2 J) : 9 :21 : 2 T ill :25) G0013 GDCoC GOO 56 00054 GOOL? 00033 GOO£9 O005T etc. 
LOCAL 


RESULTS 


(BODY 1. IE ;24 ;9 ;21 :£? -12 =25) 

(30EY 2, IE ;22 :33 3 

(BODY 3. IE :17 :3 -20) 

£B0DY 4, IE ;1 ;£) Results TOr scene f BB3DGE’ 

(BODY 5 . is :l4 :15 513) 

(BODY 6r IS :19 :18 a£) 

(BODY 7 . is :r : v :£B) 

(BODY 8. IS :8 ;11 ;6 :4 =10 3 7) 

MIL 

Unnecessary detail has "been removed from. the drawiHgSi the reader taust bear in mind 
that the eceiplete scene contains vertices (whose names do not appear ir. the drawings) 
and their corrdinates with respect to AXie which are also no- shewn, lines --edges — 
and surfaces —regions—, 
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Figure "BRIDGE’, 
he Icmg body :25 ;2i 12? i21 s9 i!2 1* 

orroctly identified. 







U l=l , ; the ptofirsi works-- The operation of SEE is quite straighfarsaflrd 1 dw 
program. 12^ Little recursive* atid not do any search- Ita p-ti parts, 

flitch are esecntEfi one after anotheri unless Otherwise indicated» are: 

TTEXSCEKE^- The pro part la e SID$ and TYJ?E are generated, for eecti verteXj if 
they were not already present. 


CiE/iIf.- Old properties used internally by SEE are rapi&v*d frow vertices and 
regions, 

EVIDENCE*"" ^ analysis is made of vertices,. regions and associated information, 
in Search for clue a that indicate that two regions for at part nf the same body T 

Tf evidence exists chat two regions in f&ct bglong to the same body T they are 
linked or marked with a gensym { IT both receive a label of the sa^s color"}. These 

* * S ■ 4 . | 

links iDay be strong (global) or weak (local), 

LOCMkVIDENCE L - Some features cf the scene will weakly suggest that soae group 
of regions should be ccnsid^red together* as part of the a a roe body- This paTt 
of the program puts these 1 local 1 links or evidences - 


GLOBAL,- The "strong" links gathered so far *ire analyzed;; regions ore grouped 
into ''nuclei 11 of bodies* which grow until some cofLtflticns fail to be satis 


detailed- explanation follows Inter) * 

m — - — - . —- . iv vi^s^nw^f^wvmr 

LOCALr" Weak evidence te cakan into account for deciding which of the utLsatlg- 
fiiCtory global Links should be considered satisfactory p And the corresponding 
nuclei of bodies flre then joined, to form, a single and bigger nuclef - 

AR&wfptionS made by LOCAL arc printed (sise output of SEE) i LOCAL may call GLOBAL 
again p or go on - 


SINGLEBOBLES - - 3t a Single region does wot belong to a bigger nuclei?;, but is 
linked by one strong evidence to other region, tt is incorporated into Che nuclei 
of the last cne, This part of the program may call GLOBAL or LOCAL again* if 
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necessary, or £0 on. 1 EINGLEBODIES " also prints its assumptions. 

RESULTS.- The regions belonging to the background are screened out, and thfc 
results ere printed. 


Example* Scene TOWER.- At this point 1 want to go into considerable detail 
to explain each one otic of the parts of SEE that have been sketched above., 
This section 1* import ant because it will help to understand the behavior of 
SEE, Its strength and defficionCOS* 

Pirst, we begin by showing a typical analysis of SEE with a socsewhat 
complicsites scene (see fig. 'TOWER'). 

The output is 
SEE 25 ANALYZES TOWER 
CLEAN 
EVIDENCE 


LOCALEVIDEHCE 

GLOBAL 

((NIL) ((tZO) QQ055 G0054 Gil055 GD052) <(:19) G0Q59 G0056 etc. 
LOCAL 

((NIL) <:20 :19 :21) 00055 G0Q52 G0059 G0056 00054 G0053) [(r etc. 
LOCAL 

<((?3 :2 si) G0077 GC0S9 GDG79 GQD7& GOQ76) ((:5 :1.5 :4) G0O49 etc 
LOCAL 


RESULTS 

(body 1. IS ;3 :2 ;1) 
(BODE 2. IS :5 :15 ;4) 
(BOUT 3. IS :23 :17) 
(SOBY 4. IS :6 ;7 ■$) 
(BODY 5. IS :IC :ll :9) 
(BODE 6. IS iI3 :14 ;I2) 
(BODY 7. IS 'IB ;22) 
(EOUy IS ;20 :19 :21) 


Results fox TOWER (see next page) 


NIL 



Figure T 0 V E R 1 . 

Neither LOCAL or SXHGLEEQDin$ are ne descry 
to correctijK pnrae this Scene into the 
bodies ^rbich ff&rm ith There sro plenty o£ 
'strong 1 links in this and SEE nu&kes 

g do^ ^se of th&m-i 












PXLLSCENE. CLEAN. “ These two parts of SEE are simple; if tieces 
C-alls SLXlJPCEIiEJtATXJK and TYPfc^ENEji^TOR; CIEAM removes acme jnwa 
The beginning o£ the definition of SEE thus locks like 




l ,S*t 

tSETO S[.3£* '(0 j'STP SLD™ 3 > [ SET 

( Sf TQ ^IJTICES ( S ( »U0Tf V 

4SEJB g*u<i! r flDJ^n {$CT SLEnE te 
(C3M3 (INFILL (9£TD TESIStaS [fi&j 
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ClEAR O f . CLi*N'\ :,- T ^ 

* t i tt t. j amt | tfh fjfc-ir r ^ 
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EVIDENCE.- Sttonj- or global links are planed 
functions are nSCdl EVERTICES and TJ0MTS. 


this part of che program 


E_yi.PfN-E "_[P*|N 

i.wfcFe (■'ITnctj 

r M a t’FJHQ 


EVEKTlCES.- This function cOClsideres rath vertcK of the Scene, under the 
following rule s: 

1,*- Vertices of the type 'L 1 are not considered. 

F0PX<“ If three regions meet Ut a vertex Of the FORK type, and none of them 
is the background, links between them will be formed. For instance* in 
fig, TOWER we establish the links ;19-:20* :19-:2l, :20-:21« Mevertha 
leas, seme of these links may not ba produced: R 

in the figurs at the right, the link between ['''‘'n. 

13 and J2 ±a not produced btt&Liae Q is a 1 "passing I 

T 1 ": Ebe link between 1 1 and ;2 is produced, \ _ 


Tbe link between 




This is a powerful heuristi And (sec fig, 1 BRIDGE') alleys us* 
for insCane e , to omit the link between regions :5 5nd in scene 
1 BRIDGE r ■ MeYerthele&s ? this sane heuristic puts & link among regions 
:fl and of the &am* scene. As ye shall see lator d this is net 
too bad. 

ARROW. - This typ-e of vertex causes two of its ragiOM (the p ieft r and Che 
'civile' one) to be joined; In the figure of the tight* we will put 
cl link bo tween :3, and s2 , which 
founts as evidence Chat fl and 
?2 belong to the same body* 

Hothing is Said about :3- 

Eor instance, is this £yp& 
of vertOK that joints :1 nnd '2 
in figure 1 BRIDGE r . 

X.- Two oases are distinguished: 

a) The X ia formed by the 
intersection of tvO lines f So 
evidence is formed + 

hj Otherwise-, itnjte :l-^ 
and :3 -e 4 are formed (see fig- 
at the right). This aecofid typo 
of X occurs when we have piles 
of objects5 for instance ? in 
fig* TOWER* s 16 and :22 nre con- 
sidoted as belonging to the same 
body* due to this typo of vertex. 

PEAK."- AH its rEglansj, CJtCOpfc the one containing the obtuaE angle ■, are 

linked co each other* See fig. CORK. 

S+- We firat look for another T to match the VErtsx currently analyzed; 
two l 1 a match if they sro colincar 
and 11 facing each otLier lh ; -the closest 
pair iE £hoaen> if ssvsral* For 
instancy A and B are paired Cfifi- at 
th& right) * An indicator h iNEXTE p ia 

placed in such verticES* ^latcbingTs. 
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Arrow links it and :2 




X: two links establishEd. 
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a) Once the flOTE ig detemined* ue establish a link between :L 


and ;2 --Last figure-- and another between :3 and ;4 + These Links 
will not be produced if the result of them is to associate 
.the background with something which is not the background T 


TES " < 


b) The following test is done; 
{sL or il in figure at right) is 
the background . but they have it 
a a a neighbor J and in some part 
of ths boundary flf il and il witta 
the background^ the segment which 
separates the&q is parallel to the 
central aegmont of the T* then 
:1 and :2 are linked. 

Tor instance ? in figure 'I 1 1 3 
this analysis applied to the vartaK 



r 

A Link is established between 


If neither^ 


T wtlL produce evidence that :13 
and : L4 belong to the body 

(ZA - AA, T - WA and OA - KA 


;l and ;l because they do not 
belong to the background* 

but this is a neighbor of both 
of them, and the Segment that 
separates :X Of the background 


Are parallcL)+This Is u rather global 
heuristic although only useful for 
boiios with parallel faces. 

Also, E.VE&T1CES classifies l r s 
acccrdipg the slope of their uenfr&i 
sCgFEifcrttS* Storing then* in the form 


{end the aarnC is ttu£ for i2) 
is parallel to OP* C&iitral 

setment of the T in question. 
(B is the background} r 


(3.5 G0001) f“10,66& G000Z) 


T ■*■ ■ 


) The numbers aro stopos^ and tfie 


gensymS contain under property 'FAS' a list of dptum^ of T* having that slope. 


TJOIHTS.- Thxs function actuates on TES and efit&blishesglobal evidences as 
described in jsrt a.. of x a (top Of this page) . 


LOC^EVII^MCE * - A Leg is an arrow £f one of left or right vertices is a 

comer (if necessary, through a chain of matched Tee) which has a 3 Ida para LLei 
to the central segment of the arrow. The function HESS finds legs in the scene* 
and stores this i nf crttl&t tan in a Hat of "weak 1 links. 





The definition of the function (LEGS N) 


where N is a 
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GLOBAL, - Strong evidence ie analyzed in this part of the program► When this section 
la entered;, several linfce (strong and veal:J exist among the ilfftTOlt regions of the 
ace tie. These lir*K§ are shown pictorially in figure 1 LINKS r > for the scene 'BRIDGE" 

(gee both). All the links to the background ( :30) arc deleted; the background can 
Spot he part of any body ■» 

Definition .: a nucleus (of a body) is either a region or a set Of nuclei which has 
been formed by the following rule^ 

Rule j if two nuclei arc connected by two or more links, they are merged into 
a larger nucleus by concatenation- 

(Two nuclei A ana D &re liilkcd if Te£ic.aE a ar.d b are linked, where SC A acid bfdO . 

For instance, region :■& cud ;11 are put together s because there exist two links 

I 

ajDO!T:g them, to form the nucleus :& - 11. How* we see that region (see fig. 'LIHSS') 
has two links with this nucleus :& - 11, and therefore the ncnf nuicleys :6 - ll - - U 
is formed. 

We let the nuclei grew antf merge under the former rule, until ho new nuclei O&n be 
foriked, When this i£ the case> the scene has been partitioned into several ’’iil&xldi&l* 1 

3 

nuclei ^ bet vtcu My %W0 or tbege ? there are zero or 3 at aost, on* For eKemjjl*, 

fig. T LUTES" will b* trangfor™&d into fig. "NUCLEI'. 



Figure 'NUCLEI p 
{See fig* r LINKS' first 
on next page), 

After Joining all nuclei baling two or n.orc links in cconon* 
the representation for the scene 1 BRIDGE r changes from that 







Figure *L E H K G 1 

This figure representa a cans 'BBIKIE 1 ^ with the strong links between 
its regions (represented here by circles) sh™, The dotted links 
represent the evidence generated by the vertex FB (gee ERIEGEj t 
(Tne short arrows show the links put by vertex v^; note that a link 
be tween i 5- and \9 is not put, because S {soo fife- BRIDGE) 1 e a pasaing 
t-Joint* Eig-sag links ArO produced by the mech^nisra described in 
part b) of T, (page 31 ) ■ 

Curled links are produced by vertex GE: even if this vertex were 

occluded, and the links mlasing^ there is a till enough evidence to 

identify regions “? and :6 aa belonging to the same tody, Weat JK-hst show*- 

See text# 
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LOGAIm ™- If seme (strong.) link ^pining two '"maximal 11 nuclei is a-lsd reinforced 
hy a weak link* theod nuclei are merged, 

T'or example s ill scene EFIPGE (see fig. r BFIDGE^ ) the following local links 
exist (among others), ;7 to ^ij -10 to “2& to ?li Id ; 1 y- 

Therefore, the corresponding nuclei are merged and how fig r NUCLEI looks likei 



Fig. 'a E W NUCLEI 8 

The figure shous the SO^nd 1 BRIDGE h * after LOCAL transforms it 
from the representation in fig P "NUCLEI 1 to the oho Showo here, 

A weak link does not cause the regions which it Links to he merged or considered 
as heionging to the tame body, unless there is in addition one strong evidence among 
such regions. LOCAL may call GLOBAL again,. if necessary, 

aiNCLEEODIES. - A strong link joining a nucleus and another nucleus COmpOsfrd ty a 
single region is considered enough evidence and the nuclei in question merged* if 
there is no other link emanating of such single region. For instancy in fig- 1 NEW 
NUCLEI 1 j. nucleus 3l6 is morgen with nucleus :l6 - 1$ [see fig*. ’FlNAl/}- Nucleus 
:2fl -29 is not joined with :Z6 - 22 - 23 or with i2^4 - 25 - 2? - 12 - 21 - ?- Even 
if nucleus tg'A - £j> were composed by a single regionstill will not be merged, since 
two links emerge from itt two nuclei gl^im its possession* 



3&. 



Figure F F I Ef A l f , 

5ISGLEBGDIES joints the lonely 
region ;1^ vith the nucleus :l6“19- 

1 I 

'Zhc definition Of the function (SUTGLEECEIEE E} is given now, where E is a 

li st of nucie i 1 each one having the form {(H, FI ^ < - - ■' ^ ^2^3^! J ' * ^ 
the Ks are region e forming a given iTOCleus 3 and the Ls are links vgenaynis } 
f:m anntfng from that r.ueleu a. 
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KE31JUPS,- Screening,put .tftp region e that belong to ttio background* tha nuclei 

^p, ' : - ■ "'■ ■■ 


are printed as 'bodies. 
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In thle process, ignore the links which may be joining some of the 
nuclei ; RESULTS considers the links of figure '‘FINAL", for instance* 
non-existent. 


DISCUSSION 

I 

Division c-f the evidence in twin kin^S, Strong and weak., a earns to be 
a good Ctmpramise■ Since SEE require® two Strong evidences tc join two 
nuclei f. I believe it will He in the "snfe 1f Side* that is, SEE will almost 
never Join two regions thst belong to different bodies. Rather* the mistakes 
Of SEE az-e of the other kind: some times, regions that should he joined 

are left "separateii. 

When there is ambiguity in the scene 3 SEE behaves CflnatmtiVttly. We 
will have nn epportunity to see this in the results of the analysis of 
£Orrtc of the acanes that Follow, 

The purpose pj" the ’veak f links is to reinforce, i£ necessary, the 
strong links. 

More heuristics could be added to increase the number of links 4 in par¬ 
ticular* given a good number of |r link prcposers r % parameters se t outside 
(by the user} would tell SEE which set of heuristics to USO; for instance* 
if knew that the scene Is formed by prisms* ue could u^e the heuristics 
that ask for parallel linos having a given configuration* ve could check the 
letigth of certain edges, etc, Ifone of this is incorporated in the actiml 
SEE program. 



SOME Itn'ZRESTISK 


EXAMPLES 


We present in this section several scenes with the results as computed 
by SEE, 


Example, 1 CORW 1 , — The program analyses the scene CORS (see tig- CORN) 
obtaining the following Identification of bodies: 

(SIHOLRBDDY ASSUMES (:2 :3 :1) (:4) SAME BODY) 

{BODY 1- IS t£ t3 :1 --k) 

(BODY 2. IS :T :fi :5) 

{BODY 3 . IS i 13 ill ; 1 £) 

{BODY h. IS : 15 il 6 :lti) 

(BODY 5 T IS H9 ?1& :17) Results for 1 COEN r 

(BODY 6. IS :£1 *30) 

{BODY T. IS J& :? :10) 

NIB 

The region got a single link with :3 S and EINGLEBCEY had to join it with 
the nucleus :1 :? :3- Note that ;4 and :12 did not got joined. The pyramid 
at the top was easily identified because its penb produces a lot of links. 

Example. 'HOMO 1 .- [Bee acene 'HOMO 1 ) The resulta are as follows: 

(LOCAL ASSUMES [3 IT) (:?) SAME BODY} 

(LOCAL ASSUMES (:? ;17) (ilS) SAME BODY) 

{BODY 1, IS 33 :2 :l) 

(BODY 2. IS :32 j33 j 27 :2o) 

(BODY 3. IS :2& :3l) 

(BODY h. IS il9 :20 :3^ :30 :29> 

(BODY 5 , IS :36 : 35 ) 

(BODY 6. IS 35 3 21 ■■'») 

(BODY 7. IS :25 :23 :22) 

(BODY 8. SB :1> :13 =15) 

(BODY 9. IS :lt> :l6 sll 312) 

(BOGY 10 . IE :lS 3 9 t 17 ) 

(BODY 11 , IE 3 ? 3 &) 

(BODY 12, IS ;3S :3T -39) 

HIL 


Results for ’MGMD r * 
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CORN 


Since u link between and ;1£ is 
not established, the bodies found 
In "that part of the scene are 
11 i2 :3 :>J and :.L1 :1£ ;1$. 























Oomnie- nts on the golut-i^n for ^QMO 1 : The central cirtea are easily isolated. 
:5l gets a iitik with =5 “id another vith i?t > so there is no need to use 
LOCAL in it, The EEime is true of ;26 with i27 acid ijt?. 

There is enough strcng evidence to Joint :2& with t3I- 

The links for :2$ :30 :3^ :20 il? and :9 317 3l& are as follows e 



The dotted links are due to the heuristic at paraULel lines between regions 
:30 and : 3b*. and between 3 20 and : 19 (see page 40 .■ ■ These links make pc b alible 
to Joint the otherwise ddaconnected nuclei 3 29- 3 32-. j1£ and t3^-> :2£?. 

In particular* if : 3^ or i2Q did net have parallel aides, GEE would have 
failed to merge these - nuclei , and would have reported two bodies . 

The disposition of regions in MOMO is such that no link is present between 
j.29 and =34* since s2& and 3 31 fall "Exactly" 1 parallel to i29 and :3E. Ir. 
a less extreme scene* ssme of these links would be present, allowing 
correct identification even if : 29" "s 3 -b— ' " 20-;19 were not a prism■ Anyway, 

SEE did not do any pel stakes. 

The triangle of links forced by 3 9* -10 and e 17 normally would have 
produced 3 separate bodies {since we need at least one double link to merge 
two regions }% nevertheless* in this case* ICO! makes some assumptions and 
saves the situation* Again* if 3 9 were not a parallelogram* there would be 
no weak links between :9 and 3l& or between 3 9 and e17 s and 3 bodies would 
have been reported instead of 39- “ 17-- bS _ But we should notice that, in 
generals two links instead of one would be between :IT and ;1&. 

Links were established henween :12 end :l3-a vlthOHt <. 

bad consequences. That is because we need two mistakes, two wrong strong 
links^to fool to the program. But chit CoulJ happen. 



HOME 

The hexagonal prisms did not cause trouble; 
GI^CLEBOIiY was jl-dcdc-d to group r3^ ^ith :3S 
The body t 3^-3$ vas identified as a single 
one h but :1^-17 ^-as reported as tuo, 
tfote that there does not exist Xqq&J; link 
between 1 21 Mjfl ;20; nfcvert hele s s T 
S1WGLSBD5Y makes the correct identification 







Example. f K D M E 1 (see scene KDMFl), The results are; 
f ei&tLEBQDY hsmms (s 3&) (: 39) same body ) 

(SIBCLEBODY ASSUMES (i3*0 SAME BODY') 

(SIKGLE30DY ASSUMES (; 25 ; 2k ;: 22 ) ( ; 23) SAME BODY) 

(SIHGLEBODY ASSUMES (3 20] (iSll GAME BODY] 

RESULTS 

(BODY 1. IS ;3 -.6 -10 !&] 

(BODY 2. IS ilk :13 :.ll :!£] 

(BODY 3. IS :9 :6) 

(BODY 4, IS slB) 

(BODY 5. IS :1& :5) 

(BODY 6, IS ;3$ ;3?) 

(BODY 7- IS :7 :?6 :£T) 

(BODY a. IS :20 :£l) Results for HOME 

(EODY 9. IS :29 :2&) 

(BODY 10. IS ijk :33) 

(BODY 11. IS :31 :3S :30] 

(BODY 12. IS :25 z2k :22 :23] 

(BODY 13. IS il6] 

(BODY ill. IS tl9) 

(BODY 15. IB 3 IT] 

{body l6. ie 336 33T t35] 

NIL 

Comment g on the aolutioo to HOME : There ia certain degree of ambiguity in 
this scenfij which hue an beings tend to resolve "by assuming parallelepipeds, 
tl€ M =17 are reported aa two separate "bodies p instead of one, which I 
thint is &. more natural answer. 

In the picture froa which was drawn ? e 13 and 218 were- the two 

faces of a single parallelepiped leaning pa :33™:: 39 % SEE report^ tl^ as 
om body and =1-9 as another - 

Nevertheless^ SEE reports t3S and ; 39 a& forcing part of the Sfljne 
body ^vbicb was in fart the caae in the picture in question) a due to the 
fact that :,-4 and :1 are background. 




1 * 1 *. 

Example* 'S P B n U',- The results are: 

{LOCAL ASSUMES (:36) (A) SAME BODY) 

{LOCAL ASSUMES (;30) (;31 :33 ;29) SAME BODY) 

{LOCAL ASSUMES (:l6) f:IT) SAME BODY) 

{LOCAL ASSUMES (t$) ( :20) SAME BODY) 

{LOCAL ASSUMES fr3 til ;?) (sl£ rIO) SAME BODY) 

(&IW3LEBODT ASSUMES fi23) (:££) SAME BODY) 

(SIMEIiEEODY ASSUMES { \\ :36) (e3T) SAME BODY) 

(SIHUjLEBODY ASSUMES (*28 :2b :3T) (:25) SAME BODY) 

{ SIHGLEBOBY ASSUMES ( : 8 ) ( : l3 ) SAME ECDY) 

RESULTS 

{BODY 1. IS ?i*0 3 30) 

{BODY 2 . IS :33 :3£) 

{EODY 3. IS ih2 ;hl) 

{BODY k. IS :h :3G :3T) 

{BODY IB : 2h ) 

(BODY 6- IS :2G -,26 :?J Be suits for SPREAD 

{BODY 7- IS :31 =32 ;29 j30) 

(BODY 3, IS :20 :5) 

(EODY 9- IS ;12 ;10 :3 ill l9) 

(BODY 10. IS :13 il :l) 

(BODY U. IS :21 :6) 

(BODY 12. IS :8 :13) 

(BODY 13. IS :1T :l5) 

(BODY ill. IS : 1*5 :^3 

(BODY 15, IS :19) 

(BODY 1 6 . IS :!5 
NIL 

Comments on the solution to SPREAD ? The body :££-23-2h, due to Insufficiemcy 
of links, was split in tvoi : 22-23 and ;£l*. 

Since there is only one link "between and :5, this body gets Split 
into two: j 6-5 and :21-20. Eote that :21 is not the 6(tie face as :£0. and 
there is where SEE wets confused and refuses to see evidence toward linking 
:21 with :20. 

The long body :9-10-11-12-3 gets properly identified - 



S P R E A D 


and : hS &r£ identified ^ £ single body. h'evcrtbeleEE ^ iS-lB-19 
Gets broken into lS-18 and :19- ^28-2T-SS-£!5 gets correctly 

identified* ft£ Some &S the fuany looking ;29-3CJ“31“-3S. 
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Exiunpl*, 'H A R D'+- This scene i£ analysed vith the following resultEr 
(LOOAL AS&UKES (ill? (tl2) SAKE BODY? 

(LOCAL ASSUMES ( 3 15) C: 16) SAKE BODY? 

results 

(BODE 1. IS :22 ;ll) 

. e 

(BODY 2. IS :±6 315) 


(BODY 3, IS :32 ;31 ;3E>) 


(BODY 4, IS 
(BODY 5- IS 
(BODY 6 . IS 
{BODY 1 . IS 
(BODY 6. IS 


:9 :I0 J&) 

£lfl :19 320) 

£13 e 17 :lk) 

r5 :4) 

:1 :2 :33) 




Restats for HAPiD 


{BODY 9, IS r24 =23 :22 :3 :£1 ;28 ;29) 
(BODY 10, IS r£5 i£6 :£7) 

(BODY 11, IS ;T) 

(BODY ;12 IS i$} 


DIL 


CffiMBeftt s on t he flolwtion to BARD E ;ly and :l£ have to niake use of weak 
evidence to get Joined end recognised as fErmine part of the S£me body. 
Wer^srbhftleefij this i£ not necessary ^ith :2& and i29^ because t through a 
chain ot Ts t there is enough evidence in = 3* i21 and [22 to Jain 
successfully aH that long and twice occluded body„ 

There ic one eerious bug la this identification: region* [7 tni :£ 
get identified as tvo Separate bodies ? and not as a single one* as one 
■would normally do. This is caused by the fact that neiglier -7 nor u .& 
hay? visible "useful 1 vertices + and there are not in than enough parallel 
lines to use the heuristic of page 31 . 


:33 ¥hs recognised as part of il-2 P as it should be. 





HARD 

n o ■* 

Body ; 21-22-3^3-2^-23-29 is reported as a singly 
object, which is correct, Also, region s33 gets 
Joined vith rl-2, as it should. Nevertheless, 
regions e? aud get reported as two bodies. 
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Ac k^owlsdgsm&nt s, 


Michael Spectner H»£e Y&luable suggest ions- 
Cornelia Sullivan helped to Codify acat of the scenes.. 
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Addendum, 


A shorter but improved version of this nemorandwn has been published: 

6.' Gunman ± An De competition of a Visual Scene into Ehree-Dimensional Bodies_ 
AF1P5 Pfuci^dinas of the 1968 FoiI_ Joint Computer Conference 

Thomps^ii Book Co + Wa thing ton ^ B, C + 


The application of SEE to etcre 0 information (two scenes 3 left and right) ; 
improvements to deal with noigy (imperfect) input* raore powerful heuristics 
for linking of regions, «tt E] will be found in a doctoral theaia; 

7_- Gutman, Ar .Cgnujuter Recognition of Three-Dimensional Qblects Eri a 
VLSAEftl.-Scene . Fh. D. Theaia p Electrical Engineering Department* 
Massachusetts Institute of Technology^ Cambridge : Maaa . (end of 19&£} 
or beginning of 1969)., Will probably appear* tOO> as a Fro j act MAC 
Technita1 Re port 




